OKAZAK1 et al. U.S. Appln. Ser. No. 09/808.939 
IN THE CLAIMS: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

1. {Cancelled). 

2. (Previously Presented) An image processing apparatus 
comprising: 

a first image sensing means for sensing an object image in a first direction to 
extract Xj number of feature points from the object image; 

a second image sensing means for sensing the object image in a second 
direction to extract X2 number of feature points from the object image; and 

a normalization means for extracting a plurality of feature points from first 
object image data obtained during sensing by the first image sensing means, checking 
whether the number of the extracted plurality of feature points corresponds to a preset 
Xj number, extracting a plurality of feature points from second object image data 

obtained during sensing by the second image sensing means, checking whether the 
number of the extracted plurality of feature points corresponds to a preset X2 number, 
setting a first feature region on the first object image data by a first method based on 
the X\ number of feature points, setting a second feature region on the second object 
image data by a second method based on the X2 number of feature points, segmenting 

the first feature region into a plurality of regions, computing predetermined 
information in each segmented region, computing a first feature pattern based on the 
computed predetermined information, segmenting the second feature region into a 
plurality of regions, computing predetermined information in each segmented region, 
and computing a second feature pattern based on the computed predetermined 
information. 

3. (Previously Presented) An image processing apparatus 
comprising: 
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a first image sensing means for sensing an object image in a first direction to 
extract X\ number of feature points from the object image; 

a second image sensing means for sensing the object image in a second 
direction to extract X2 number of feature points; 

a normalization means for extracting a plurality of feature points from first 
object image data obtained during sensing by the first image sensing means, checking 
whether the number of the extracted plurality of feature points corresponds to a preset 
X\ number, extracting a plurality of feature points from second object data obtained in 

sensing by the second image sensing means, checking whether the number of the 
extracted plurality of feature points corresponds to a preset X2 number, setting a first 

feature region on the first object image data by a first method based on the X\ number 

of feature points, setting a second feature region on the second image data by a second 
method based on the X2 number of feature points, segmenting the first feature region 
into a plurality of regions, computing an average value of brightness levels in each 
segmented region, computing a first feature pattern based on the computed average 
value, segmenting the second feature region into a plurality of regions, computing an 
average value of brightness levels in each segmented region, and computing a second 
feature pattern based on the computed average value; 

registration means for registering the first and second feature patterns computed 
by said normalization means as feature patterns associated with a predetermined object; 
and 

verification means for specifying an object associated with the object image by 
comparing the first and second feature patterns computed by said normalization means 
with the first and second feature patterns registered in said registration means. 

4. (Previously Presented) An apparatus according to claim 3, 

wherein said first and second image sensing means line up vertically, and 

said normalization means computes the feature patterns using the X\ number of 
feature points including central points of right and left pupils and central points of right 
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and left nasal cavities of the first object image data, and the number of feature 
points including central points of right and left pupils of the second object image data. 

5. (Previously Presented) An apparatus according to claim 3, 
wherein said first and second image sensing means line up horizontally, and 

said normalization means computes the feature patterns using the Xj number of 

feature points including central points of right and left pupils and central points of right 
and left nasal cavities of the first object image data, and the X2 number of feature 

points including central points of right and left pupils and a central point of a left or 
light nasal cavity of the second object image data. 

6. (Previously Presented) An apparatus according to claim 3, further 
comprising: 

a third image sensing means for sensing the object image in a third direction to 
extract X3 number of feature points from the object image; and 

a fourth image sensing means for sensing the object image in a fourth direction 
to extract X4 number of feature points from the object image, 

wherein said first and second image sensing means line up horizontally; 

said third and fourth image sensing means line up vertically; 

said normalization means extracts a plurality of feature points from third object 
image data obtained in sensing by the third image sensing means, checks whether the 
number of the extracted plurality of feature points corresponds to a preset X3 number, 
extracts a plurality of feature points from fourth object image data obtained in sensing 
by the fourth image sensing means, checks whether the number of the extracted 
plurality of feature points corresponds to a preset X4 number, sets a third feature region 
on the third object image data by a third method based on the X3 number of feature 
points, sets a fourth feature region on the fourth object image data by a fourth method 
based on the X4 number of feature points, segments the third feature region into a 
plurality of regions, computes an average value of brightness levels in each segmented 
region, computes a third feature pattern based on the computed average value, segments 
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the fourth feature region into a plurality of regions, computes an average value of 
brightness levels in each segmented region, computes a fourth feature pattern based on 
the computed average value, and computes the first and second feature patterns and a 
third and fourth feature patterns by using the number of feature points including 
central points of right and left pupils and central points of right and left nasal cavities of 
the first object image data, the X2 number of feature points including central points of 
right and left pupils of the second object image data, the X3 number of feature points 

including central points of right and left pupils and central points of right and left nasal 
cavities of the third object image data, and the X4 number of feature points including 
central points of right and left pupils and central points of left or right nasal cavities of 
the third object image data; 

said registration means registers the first, second, third, and fourth feature 
patterns computed by said normalization means as feature patterns associated with a 
predetermined object; 

said verification means specifies an object associated with the first, second, 
third, and fourth object image data by comparing the first, second, third and fourth 
feature patterns computed by said normalization means with the first, second, third and 
fourth feature patterns registered in said registration means. 

7. (Previously Presented) An apparatus according to claim 3, 
wherein said normalization means extracts feature vectors of different dimensions from 
the respective first and second object image data acquired by said first and second 
image sensing means, and arranges the extracted feature vectors of different dimensions 
in turn to integrate them as a multi-dimensional feature pattern. 

8. (Previously Presented) An apparatus according to claim 3, 
wherein said normalization means captures the first and second object image data 
acquired by said first and second image sensing means at predetermined time intervals, 
computes feature patterns of the first and second object image data of identical times, 
and arranges feature patterns of different times in turn to integrate them as a time-series 
feature pattern. 
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9. (Previously Presented) An image processing apparatus 
comprising: 

an image input means for sensing an object image in a first direction to extract 
X\ number of feature points from the object image, inputting first object image data 
obtained by the sensing, sensing the object image in a second direction to extract X2 

number of feature points from the object image, and inputting second object image data 
obtained by the sensing; 

a feature extraction means for extracting a plurality of feature points from the 
first object image data input by the image input means, checking whether the number of 
the extracted plurality of feature points corresponds to a preset X\ number, extracting a 

plurality of feature points from the second object image data input by the image input 
means, checking whether the number of the extracted plurality of feature points 
corresponds to a preset X2 number, setting a first feature region on the first object 

image data by a first method based on the X^ number of feature points, setting a 

second feature region on the second object image data by a second method based on 
the X2 number of feature points, extracting a first feature pattern from the first feature 
region, and extracting a second feature pattern from the second feature region; 

verification means for verifying the first and second feature patterns extracted 
by said feature extraction means with first and second reference feature patterns which 
are registered in advance; and 

discrimination means for, when at least one of the first and second feature 
patterns extracted by said feature extraction means matches the first and second 
reference feature patterns which are registered in advance as a result of verification of 
said verification means, determining that an object associated with the first and second 
object image data is a person himself or herself ^ 

10. (Previously Presented) An apparatus according to claim 9, 
wherein said image input means has first and second image sensing means which are 
set in advance at first and second positions, and sense an object image from first and 
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second positions, and inputs the first and second object image data at the first and 
second image sensing positions using said first and second image sensing means. 

11. (Previously Presented) An apparatus according to claim 9, 
wherein said feature extraction means comprises: 

a feature pattern extraction means for segmenting the first feature region into a 
plurality of regions, computing an average value of brightness levels in each segmented 
region, computing a first feature pattern based on the computed average value, 
segmenting the second feature region into a plurality of regions, computing an average 
value of brightness levels in each segmented region, and computing a second feature 
pattern based on the computed average value. 

12. (Previously Presented) An image processing apparatus 
comprising: 

image processing means for sensing object images from different directions, 
extracting feature points from the sensed object images, and computing a feature 
pattern on the basis of the extracted feature points; 

image input means for sensing an object image from different positions, and 
inputting a plurality of object images at different image sensing positions; 

input image determination means for determining an image sensing position of 
an object image to be used from the plurality of object images input by said image input 
means upon registration of a feature pattern; 

first feature extraction means for extracting a feature pattern which represents a 
feature of an object from the object image determined by said input image 
determination means; 

registration means for registering the feature pattern extracted by said first 
feature extraction means as a reference feature pattern associated with the object in 
correspondence with position information indicating the image sensing position of the 
corresponding object image; 

verification image selection means for selecting an object image at an image 
sensing position, which corresponds to the position information registered together with 
the feature pattern of the object to be verified registered in said registration means, of 
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the plurality of object images input by said image input means upon verification of a 
feature pattern; 

second feature extraction means for extracting a feature pattern which 
represents a feature of the object from the object image selected by said verification 
image selection means; and 

verification means for specifying an object associated with the object image by 
verifying the feature pattern extracted by said second feature extraction means with the 
feature pattern of the object to be verified registered in said registration means. 

13. (Cancelled). 

14. {Previously Presented) An image processing apparatus 
comprising: 

image processing means for sensing object images from different directions, 
extracting feature points from the sensed object images, and computing a feature 
pattern on the basis of the extracted feature points; 

a plurality of image sensing means, respectively set in advance at a plurality of 
predetermined positions, for sensing an object image from a plurality of different 
positions; 

determination means for determining a position of the image sensing means to 
be used of said plurality of image sensing means upon registration of a feature pattern; 

first feature extraction means for extracting a feature pattern which represents a 
feature of an object from the object image obtained by the image sensing means 
determined by said determination means; 

registration means for registering the feature pattern extracted by said first 
feature extraction means as a reference feature pattern associated with the object in 
correspondence with position information indicating the position of the image sensing 
means determined by said determination means; 

selection means for selecting the image sensing means at a position, which 
corresponds to the position information registered together with the feature pattern of 
the object in said registration means, of said plurality of image sensing means upon 
verification of a feature pattern; 
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second feature extraction means for extracting a feature pattern which 
represents a feature of the object from the object image obtained by the image sensing 
means selected by said selection means; and 

verification means for specifying an object associated with the object image by 
verifying the feature pattern extracted by said second feature extraction means with the 
feature pattern of the object registered in said registration means. 

15. {Original) An apparatus according to claim 14, wherein each of said 
first and second feature extraction means comprises: 

feature point detection means for detecting feature points of an object from the 
input object image; 

feature region setting means for setting a feature region on the basis of the 
feature points detected by said feature point detection means; 

region segmentation means for segmenting the feature region set by said feature 
region setting means into a plurality of regions; and 

feature pattern extraction means for computing brightness average values in the 
regions segmented by said region segmentation means, and extracting a feature pattern 
which represents a feature of the object on the basis of the brightness average values. 

16. {Cancelled). 

1 7. (Previously Presented) An image processing method comprising: 
the first step of sensing an object image in a first direction to extract X\ number 

of feature points from the object image, and sensing the object image in a second 
direction to extract X2 number of feature points from the object image; and 

the second step of extracting a plurality of feature points from first object 
image data obtained by the sensing of the first step, checking whether the number of 
the extracted plurality of feature points corresponds to a preset X\ number, extracting a 

plurality of feature points from second object image data obtained by the sensing of 
the first step, checking whether the number of the extracted plurality of feature points 
corresponds to a preset X2 number, setting a first feature region on the first object 
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image data by a first method based on the X\ number of feature points, setting a 
second feature region on the second object image data by a second method based on 
the Xj number of feature points, segmenting the first feature region into a plurality of 
regions, computing predetermined information in each segmented region, computing a 
first feature pattern based on the computed predetermined information, segmenting the 
second feature region into a plurality of regions, computing predetermined information 
in each segmented region, and computing a second feature pattern based on the 
predetermined information. 

18. (Currently Amended) An image processing method comprising: 

the first step of sensing an object image in a first direction to extract Xj number 

of feature points from the object image, and s e nding sensing the object image in a 
second direction to extract X2 number of feature points from the object image; 

the second step of extracting a plurality of feature points from first object 
image data obtained by the sensing of the first step, checking whether the number of 
the extracted plurality of feature points corresponds to a preset Xi number, extracting a 

plurality of feature points from second object image data obtained by the sensing of 
the first step, checking whether the number of the extracted plurality of feature points 
corresponds to a preset X2 number, setting a first feature region on the first object 
image data by a first method based on the X\ number of feature points, setting a 
second feature region on the second object image data by a second method based on 
the X2 number of feature points, segmenting the first feature region into a plurality of 
regions, computing an average value of brightness levels in each segmented region, 
computing a first feature pattern based on the computed average value, segmenting the 
second feature region into a plurality of regions, computing an average value of 
brightness levels in each segmented region, and computing a second feature pattern 
based on the computed average value; 

the third step of registering the first and second feature patterns computed in the 
second step as arfeature patterns associated with a predetermined object; and 
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the fourth step of specifying an object associated with the object image by 
comparing the first and second feature patterns computed in the second step with the 
first and second feature patterns registered in the third step. 

19. (Previously Presented) A method according to claim 18, wherein 
the first step includes the step of sensing the object image from the first and second 
directions which line up vertically, and 

the second step includes the step of computing the feature pattern using the Xj 
number of feature points including central points of right and left pupils and central 
points of right and left nasal cavities of the first object image data, and the X2 number 

of feature points including central points of right and left pupils of the second object 
image data. 

20. (Previously Presented) A method according to claim 18, wherein 
the first step includes the step of sensing the object image from the first and second 
directions which line up horizontally, and 

the second step includes the step of computing the feature pattern using the X\ 

number of feature points including central points of right and left pupils and central 
points of right and left nasal cavities of the first object image data, and the X2 number 

of feature points including central points of right and left pupils and a central point of a 
left or light nasal cavity of the second object image data. 

21. (Previously Presented) A method according to claim 18, wherein 
the first step includes the step of sensing the object image in a third direction to extract 
X3 number of feature points from the object image, and sensing the object image in a 

fourth direction to extract X4 number of feature points from the object image; 

said first and second directions are horizontal direction and said third and fourth 
directions are vertical direction; 

said second step includes extracting a plurality of feature points from third 
object image data obtained by the sensing in the third direction, checking whether the 
number of the extracted plurality of features points corresponds to a preset X3 number, 
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extracting a plurality of feature points from fourth object image data obtained by the 
sensing in the fourth direction, checking whether the number of the extracted plurality 
of feature points corresponds to a preset X4 number, setting a third feature region on 
the third object image data by a third method based on the X3 number of feature points, 

setting a fourth region on the fourth object image data by a fourth method based on the 
X4 number of feature points, segmenting the third feature region into a plurality of 

regions, computing an average value of brightness levels in each segmented region, 
computing a third feature pattern based on the computed average value, segmenting the 
fourth feature region into a plurality of regions, computing an average value of 
brightness levels in each segmented region, computing a fourth feature pattern based on 
the computed average value, computing the first and second feature patterns and a third 
and fourth feature patterns by using the X\ number of feature points including central 

points of right and left pupils and central points of right and left nasal cavities of the 
first object image data, the X2 number of feature points including central points of right 

and left pupils of the second object image data, the X3 number of feature points 

including central points of right and left pupils and central points of right and left nasal 
cavities of the third object image data, and the X4 number of feature points including 

central points of right and left pupils and central points of left or right nasal cavities of 
the third object image data; 

said third step registers the first, second, third, and fourth feature patterns 
computed in the second step as feature patterns associated with a predetermined object; 
and 

said fourth step specifies an object associated with the first, second, third, and 
fourth object image data by comparing the first, second, third and fourth feature 
patterns computed by said second step with the first, second, third and fourth feature 
patterns registered in said third step. 

22. (Previously Presented) A method according to claim 18, wherein 

the second step includes the step of extracting feature vectors of different dimensions 
from respective the first and second object image data acquired in the first step, and 
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arranging the extracted feature vectors of different dimensions in turn to integrate them 
as a multi-dimensional feature pattern. 

23. (Previously Presented) A method according to claim 18, wherein 
the second step includes the step of capturing the first and second object image data 
acquired in the first step at predetermined time intervals, computing feature patterns of 
the first and second object image data of identical times, and arranging feature patterns 
of different times in turn to integrate them as a time-series feature pattern. 

24. (Previously Presented) An image processing method comprising: 
the first step of sensing an object image in a first direction to extract Xj number 

of feature points from the object image, inputting first object image data obtained by 
the sensing, sensing the object image in a second direction to extract X2 number of 

feature points from the object image, and inputting second object image data obtained 
by the sensing; 

the second step of extracting a plurality of object image data from the first 
object image data input in the first step, checking whether the number of the extracted 
plurality of feature points corresponds to a preset Xj number, extracting a plurality of 

feature points from the second object image data input in the first step, checking 
whether the number of extracted plurality of feature points corresponds to a preset X2 

number, setting a first feature region on the first object image data by a first method 
based on the X\ number of feature points, setting a second feature region on the 

second object image data by a second method based on the X2 number of feature 
points, extracting a first feature pattern from the first feature region, and extracting a 
second feature pattern from the second feature region; 

the third step of verifying the first and second feature patterns extracted in the 
second step with first and second reference feature patterns which are is registered in 
advance; and 

the fourth step of determining, when at least one of first and second feature 
patterns extracted in the second step matches the first and second reference feature 
patterns which are registered in advance as a result of verification of the third step, that 
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an object associated with the first and second object image data is a person himself or 
herself. 

25. (Previously Presented) A method according to claim 24, wherein 
the first step includes the step of inputting the first and second object image data at the 
first and second image sensing positions using first and second image sensing means 
which are set in advance at first and second positions, and sense an object image from 
the first and second positions. 

26. (Previously Presented) A method according to claim 24, wherein 
the second step includes: 

segmenting the first feature region into a plurality of regions, computing an 
average value of brightness levels in each segmented region, computing a first feature 
pattern based on the computed average value, segmenting the second feature region 
into a plurality of regions, computing an average value of brightness levels in each 
segmented region, computing a second feature pattern based on the computed average 
value. 

27. (Previously Presented) An image processing method comprising: 
the first step of sensing object images from different positions, extracting 

feature points from the sensed object images, and computing a feature pattern on the 
basis of the extracted feature points, and inputting a plurality of object images at 
different image sensing positions; 

the second step of determining an image sensing position of an object image to 
be used from the plurality of object images input in the first step upon registration of a 
feature pattern; 

the third step of extracting a feature pattern which represents a feature of an 
object from the object image determined in the second step; 

the fourth step of registering the feature pattern extracted in the third step as a 
reference feature pattern associated with the object in correspondence with position 
information indicating the image sensing position of the corresponding object image; 
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the fifth step of selecting an object image at an image sensing position, which 
corresponds to the position information registered together with the feature pattern of 
the object to be verified registered in the fourth step, of the plurality of object images 
input in the first step upon verification of a feature pattern; 

the sixth step of extracting a feature pattern which represents a feature of the 
object from the object image selected in the fifth step; and 

the seventh step of specifying an object associated with the object image by 
verifying the feature pattern extracted in the sixth step with the feature pattern of the 
object to be verified registered in the fourth step. 

28. (Cancelled). 

29. (Previously Presented) An image processing method comprising: 
the first step of sensing object images from different positions, extracting 

feature points from the sensed object images, and computing a feature pattern on the 
basis of the extracted feature points, wherein the first step of inputting a plurality of 
object images at different image sensing positions uses a plurality of image sensing 
means, respectively set in advance at a plurality of predetermined positions, for sensing 
an object image from a plurality of different positions; 

the second step of determining a position of the image sensing means to be used 
of said plurality of image sensing means upon registration of a feature pattern; 

the third step of extracting a feature pattern which represents a feature of an 
object from the object image obtained by the image sensing means determined in the 
second step; 

the fourth step of registering the feature pattern extracted in the third step as a 
reference feature pattern associated with the object in correspondence with position 
information indicating the position of the image sensing means determined in the 
second step; 

the fifth step of selecting the image sensing means at a position, which 
corresponds to the position information registered together with the feature pattern of 
the object in the fourth step, of said plurality of image sensing means upon verification 
of a feature pattern; 
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the sixth step of extracting a feature pattern which represents a feature of the 
object from the object image obtained by the image sensing means selected in the fifth 
step; and 

the seventh step of specifying an object associated with the object image by 
verifying the feature pattern extracted in the sixth step with the feature pattern of the 
object registered in the fourth step. 

30. {Original) A method according to claim 29, wherein each of the 
third and sixth steps includes: 

the step of detecting feature points of an object from the input object image; 

the step of setting a feature region on the basis of the detected feature points; 

the step of segmenting the set feature region into a plurality of regions; and 

the step of computing brightness average values in the segmented regions, and 
extracting a feature pattern which represents a feature of the object on the basis of the 
brightness average values. 



30481467v1 



16 



